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O ' Abstract 
(N ■ 

We study vertex cut and flow sparsifiers that were recently introduced by Moitra (2009), 
and Leighton and Moitra (2010). We improve and generalize their results. We give a new 
' polynomial-time algorithm for constructing 0(log k/ log log k) cut and flow sparsifiers, matching 

\ the best known existential upper bound on the quality of a sparsifier, and improving the previous 

■ algorithmic upper bound of 0(log^ fc/loglogfc). We show that flow sparsiflers can be obtained 
from linear operators approximating minimum metric extensions. We introduce the notion of 

• (linear) metric extension operators, prove that they exist, and give an exact polynomial-time 

I algorithm for finding optimal operators. 

^ • We then establish a direct connection between fiow and cut sparsifiers and Lipschitz extend- 

Q I ability of maps in Banach spaces, a notion studied in functional analysis since 1930s. Using 

this connection, we obtain a lower bound of r2(-\/log fc/ log log k) for fiow sparsifiers and a lower 

I bound of V,{y/log k/ log log fc) for cut sparsifiers. We show that if a certain open question posed 

^ ■ by Ball in 1992 has a positive answer, then there exist 0{\/\og k) cut sparsifiers. On the other 

\ hand, any lower bound on cut sparsifiers better than r2(vlogfc) would imply a negative answer 

■ to this question. 

: 

\D • 1 Introduction 

O : 

' In this paper, we study vertex cut and flow sparsifiers that were recently introduced by Moitra 

^ ■ (2009), and Leighton and Moitra (2010). A weighted graph H = {U,/3) is a Q-quality vertex cut 

• ^ , sparsifier of a weighted graph G = (V, a) (here Oij and f3pq are sets of weights on edges of G and 

^ ' H) ii U C V and the size of every cut {S,U \ S) in H approximates the size of the minimum 

■ cut separating sets S and U \ S in G within a factor of Q. Moitra (2009) presented several 
important applications of cut sparsifiers to the theory of approximation algorithms. Consider a 
simple example. Suppose we want to find the minimum cut in a graph G = {V, a) that splits a 
given subset of vertices (terminals) U C V into two approximately equal parts. We construct Q- 
quality sparsifier H = {U, /3) of G, and then find a balanced cut (S, U\S) in H using the algorithm 
of Arora, Rao, and Vazirani (2004). The desired cut is the minimum cut in G separating sets S 
and U \ S. The approximation ratio we get is 0{Q x y^log \ U\): we lose a factor of Q by using 
cut sparsifiers, and another factor of 0( y^log \U\) by using the approximation algorithm for the 
balanced cut problem. If we applied the approximation algorithm for the balanced, or, perhaps, 
the sparsest cut problem directly we would lose a factor of 0(y^log \V\). This factor depends on 
the number of vertices in the graph G, which may be much larger than the number of vertices 
in the graph H. Note, that we gave the example above just to illustrate the method. A detailed 
overview of applications of cut and flow sparsifiers is presented in the papers of Moitra (2009) 
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and Leighton and Moitra (2010). However, even this simple example shows that we would like 
to construct sparsifiers with Q as small as possible. Moitra (2009) proved that for every graph 
G = {V^a) and every /c-vertex subset U C V, there exists a 0(log A;/ log log A;)-quality sparsifier 
H = (U, P). However, the best known polynomial-time algorithm proposed by Leighton and Moitra 
(2010) finds only 0(log^ A;/ log log /c)-quality sparsifiers. In this paper, we close this gap: we give 
a polynomial-time algorithm for constructing 0(log A;/ log log A;)-cut sparsifiers matching the best 
known existential upper bound. In fact, our algorithm constructs 0(log A:/ log log k)-flow sparsifiers. 
This type of sparsifiers was introduced by Leighton and Moitra (2010); and it generalizes the 
notion of cut-sparsifiers. Our bound matches the existential upper bound of Leighton and Moitra 
(2010) and improves their algorithmic upper bound of 0(log^ A:/ log log A;) . If G is a graph with an 
excluded minor -fC^.n then our algorithm finds a 0(r^ )-quality fiow sparsifier, again matching the 
best existential upper bound of Leighton and Moitra (2010) (Their algorithmic upper bound has 
an additional log A; factor). Similarly, we get 0(log (7)-quality fiow sparsifiers for genus g graph^. 

In the second part of the paper (Section[5]), we establish a direct connection between fiow and cut 
sparsifiers and Lipschitz extendability of maps in Banach spaces. Let Q'j^^ (respectively, Q]^^^"'^) be 
the minimum over all Q such that there exists a Q-quality cut (respectively, flow) sparsifier for every 
graph G = {y,a) and every subset U C V size k. We show that Q'^^ = ekiii,ii) and Q^<^^^^'^ = 
efc(oo,^oo ®i • • • ®i ^oo), where efc(£i,£i) and 6^(00,^00 ®i • • • ®i ioo) are the Lipschitz extendability 
constants (see Section [5] for the definitions). That is, there always exist cut and fiow sparsifiers of 
quality ek{ii,ii) and 6^(00,^00 ®i • • • ®i ^00), respectively; and these bounds cannot be improved. 
We then prove lower bounds on Lipschitz extendability constants and obtain a lower bound of 
ri(Y^log A;/ log log k) on the quality of flow sparsifiers and a lower bound of r2( y^log k/ log log A;) on 
the quality of cut sparsifiers (improving upon previously known lower bound of r2(loglogA;) and 
0(1) respectively). To this end, we employ the connection between Lipschitz extendability constants 
and relative projection constants that was discovered by Johnson and Lindenstrauss (1984). Our 
bound on 6^(00,^00 ®i • • • ®i ^00) immediately follows from the bound of Griinbaum (1960) on the 
projection constant X{£f,£oo)- To get the bound of Q{y^log k/ log log A;) on ek{h,£i), we prove a 
lower bound on the projection constant \{L,ii) for a carefully chosen subspace L of ^1. After a 
preliminary version of our paper appeared as a preprint, Johnson and Schechtman notified us that 
a lower bound of ^{-^log k / log log A:) on ek{ii,ii) follows from their joint work with Figiel (Figiel, 
Johnson, and Schechtman 1988). With their permission, we present the proof of the lower bound 
in Section Oof the Appendix, which gives a lower bound of ^l{y/log k/ log log A;) on the quality of 
cut sparsifiers. 

In Section 15.31 we note that we can use the connection between vertex sparsifiers and extend- 
ability constants not only to prove lower bounds, but also to get positive results. We show that 
surprisingly if a certain open question in functional analysis posed by Ball (1992) has a positive an- 
swer, then there exist 0{\/\og A;)-quality cut sparsifiers. This is both an indication that the current 
upper bound of O (log A;/ log log A;) might not be optimal and that improving lower bounds beyond 
of 0{\/\og k) will require solving a long standing open problem (negatively). 

Finally, in Section [6l we show that there exist simple "combinatorial certificates" that certify 
that Q^"* > Q and g™^*"^ > Q. 

^Independently and concurrently to our work, Charikar, Leighton, Li, and Moitra (2010), and independently 
Englert, Gupta, Krauthgamer, Racke, Talgam- Cohen and Talwar (2010) obtained results similar to some of our 
results. 
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Overview of the Algorithm. The main technical ingredient of our algorithm is a procedure 
for finding linear approximations to metric extensions. Consider a set of points X and a fc-point 
subset y C X. Let T>x be the cone of all metrics on X, and Vy be the cone of all metrics on Y . 
For a given set of weights a^j on pairs (i, j) G X x X , the minimum extension of a metric dy from 
y to X is a metric dx on X that coincides with dy on Y and minimizes the linear functional 

a{dx) = ^ aijdxiij). 
i,jex 

We denote the minimum above by min-exty_>.x (dy , a) . We show that the map between dy and 
its minimum extension, the metric dx, can be well approximated by a linear operator. Namely, 
for every set of nonnegative weights aij on pairs E X X X, there exists a linear operator 

(f) : Vy — > Vx of the form 

HdY){i,j)= XI 4>ip3qdY{p,q) (1) 

that maps every metric dy to an extension of the metric dy to the set X such that 

(log k \ 
- — ; -| min-ext(dy, a), 
log log k J Y^X 

As a corollary, the linear functional /3 : Vx — > M defined as I3{dy) = ^^j^x '^ij4'{dy){i,j) approxi- 
mates the minimum extension of dy up to 0(log k/ log log k) factor. We then give a polynomial-time 
algorithm for finding (j) and (5. (The algorithm finds the optimal (j).) To see the connection with 
cut and flow sparsifiers write the linear operator P{dy) as P{dy) = g^y Ppqdy(j),q), then 

- — ; -1 min-ext(dy, a). (2) 

log log k J Y-^X ^ ' ^ ^ ' 

Note that the minimum extension of a cut metric is a cut metric (since the mincut LP is integral) . 
Now, if dy is a cut metric on Y corresponding to the cut {S,Y \ S), then J2p q&Y f^pqdY{p,Q) is 
the size of the cut in Y with respect to the weights Ppq-, and min-exty-^x(t^y , a) is the size of the 
minimum cut in X separating S and Y\S. Thus, {Y, P) is a 0(log k/ log log A;)-quality cut sparsifier 
for [X,a). 

Definition 1.1 (Cut sparsifier (Moitra 2009)). Let G = {V,a) be a weighted undirected graph 
with weights aij; and let U C V be a subset of vertices. We say that a weighted undirected graph 
H = {U,P) on U is a Q-quality cut sparsifier, if for every S C U, the size the cut {S, U \ S) in H 
approximates the size of the minimum cut separating S and U\S in G within a factor of Q i.e., 

min > an < > B„o < Q x min > an. 

TcV:S=TnU ^ ^ T(ZV:S=TnU ^ ^ 

ieT pes ieT 

jev\T qeu\s jev\T 

2 Preliminaries 

In this section, we remind the reader some basic definitions. 
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2.1 Multi-commodity Flows and Flow-Sparsifiers 



Definition 2.1. Let G = (V, a) be a weighted graph with nonnegative capacities aij between vertices 

i,j G V, and let {(s^., t^; denir)} be a set of flow demands (sr,tr G V are terminals of the graph, 
deuir G M are demands between Sr and t,.; all demands are nonnegative). We say that a weighted 
collection of paths V with nonnegative weights Wp (p G V) is a fractional multi- commodity flow 
concurrently satisfying a A fraction of all demands, if the following two conditions hold. 

• Capacity constraints. For every pair & V x V, 



Demand constraints. For every demand (s^, i^, dem^), 



Wp> \ dem^ . (4) 

p&V'.p goes from Sr to tr 



We denote the maximum fraction of all satisfied demands by max-fiow(G, {(s^, i^i dem^)}). 

For a detailed overview of multi-commodity flows, we refer the reader to the book of Schrijver 
(2003). 

Definition 2.2 (Leighton and Moitra (2010)). Let G = (V,a) be a weighted graph and let U C V 

be a subset of vertices. We say that a graph H = {U, /3) on U is a Q-quality flow sparsifier of G if 
for every set of demands {{sr,tr,denir)} between terminals in U, 

max-flow(G, {(sr, if) dem^)}) < max-flow(iJ, {(s^, dem^)}) < Q x max-flow(G, {(s^, ir, dem^)}). 
Leighton and Moitra (2010) showed that every flow sparsifier is a cut sparsifier. 

Theorem 2.3 (Leighton and Moitra (2010)). If H = (U, P) is a Q-quality flow sparsifier for 
G = {V, Oi), then H = (J7, j3) is also a Q-quality cut sparsifier for G = (i/, a). 



2.2 Metric Spaces and Metric Extensions 

Recall that a function dx : X x X — > M is a metric if for all j,k e X the following three conditions 

hold dx{i,j) > 0, dx{i,j) = dx{j, i), dx{i, j) + dx{j, k) > dx{i, k). Usually, the definition of metric 
requires that dx{i,j) 7^ for distinct i and j but we drop this requirement for convenience (such 
metrics are often called semimetrics). We denote the set of all metrics on a set X by Vx- Note, 
that Vx is a convex closed cone. Moreover, Vx is defined by polynomially many (in \X\) linear 
constraints (namely, by the three inequalities above for all i,j,k G X). 

A map / from a metric space {X, dx) to a metric space {Z, dz) is C-Lipschitz, if dz{f{i), f{j)) ^ 
Cdx{i,j) for all i,j G X. The Lipschitz norm of a Lipschitz map / equals 
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Definition 2.4 (Metric extension and metric restriction). Let X he an arbitrary set, Y C X , and 
dy be a metric on Y. We say that dx is a metric extension of dy to X if dxip,q) = dY{p,q) for 
allp,q € Y. If dx is an extension of dy, then dy is the restriction of dx to Y. We denote the 
restriction of dx to Y by dx\y (clearly, dx\y is uniquely defined by dx)- 

Definition 2.5 (Minimum extension). Let X be an arbitrary set, Y C X , and dy be a metric on 
Y. The minimum (cost) extension of dy to X with respect to a set of nonnegative weights Uij on 
pairs {i,j) £ X x X is a metric extension dx of dy that minimizes the linear functional a{dx): 

a{dx) = ^ aijdx{i,j). 

i,j&X 

We denote a{dx) by min-exty_i.x(dy, a). 

Lemma 2.6. Let X be an arbitrary set, Y C X , and aij be a set of nonnegative weights on pairs 
{i,j) £ X X X. Then the function min-exty _>.x (c^y , a) is a convex function of the first variable. 

Proof. Consider arbitrary metrics dy and dy in T>y. Let dx and dx be their minimal extensions 
to X. For every A G [0, 1], the metric Xd*x + (1 — X)d*x is an extension (but not necessarily the 
minimum extension) of Xdy + (1 — A)(iy to X, 

min-ext(Ad;. + (1 - A)d^*,a) < ^ aiji{Xd*x{i, j) + (1 - X)d*^{i,j))) = 

X aijd*x{i,j) + (1 — A) aijd*x{i,j) = A min-ext(c?y , a) + (1 — A) min-ext(dy , a). 

□ 

Later, we shall need the following theorem of Fakcharoenphol, Harrelson, Rao, and Talwar 
(2003). 

Theorem 2.7 (FHRT 0-extension Theorem). Let X be a set of points, Y be a k-point subset of 
X, and dy G T>y be a metric on Y . Then for every set of nonnegative weights Uij on X x X , there 
exists a map (0-extension) f : X ^ Y such that f{p) = p for every p gY and 

^ aij ■dy{f{i)J{j)) < 0{\ogk/\og\ogk) x vam-e^i{dy , a) . 

The notion of 0-extension was introduced by Karzanov (1998). A slightly weaker version of 
this theorem (with a guarantee of 0{\ogk)) was proved earlier by Calinescu, Karloff, and Rabani 
(2001). 

3 Metric Extension Operators 

In this section, we introduce the definitions of "metric extension operators" and "metric vertex 
sparsifiers" and then establish a connection between them and flow sparsifiers. Specifically, we 
show that each Q-quality metric sparsifier is a Q-quality flow sparsifier and vice versa (Lemma 13. 51 
Lemma lA.ip . In the next section, we prove that there exist metric extension operators with 
distortion 0(log fc/ log log /c) and give an algorithm that finds the optimal extension operator. 
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Definition 3.1 (Metric extension operator). Let X be a set of points, and Y be a k-point subset 
of X . We say that a linear operator (j) : T>y — ^ T^x defined as 

4>{dY){i,j)= ^ 4'ipjqdY{p,q) 

p,qeY 

is a Q-distortion metric extension operator with respect to a set of nonnegative weights aij, if 

• for every metric dy G T^Yj metric </>(dy) is a metric extension of dy; 

• for every metric dy G Vy, 

a{4){dy)) = aij(j){dy){i, j) <Qx min-ext((iy , a). 

i,jex 

Remark: As we show in Lemma \3.3l a stronger bound always holds: 

min-extfdy , q) <ct((j)(dy)) < Q x mm-ext(dy,a). 
Y^x Y^x 



for all i,j £ X, and p,q € Y, 



We shall always identify the operator (p with its matrix 



Definition 3.2 (Metric vertex sparsifier). Let X be a set of points, and Y be a k-point subset of 
X . We say that a linear functional (3 : T)y — )• R defined as 

P{dY)= ^ /3pqdY{p,q) 

p,q€Y 

is a Q-quality metric vertex sparsifier with respect to a set of nonnegative weights aij, if for every 
metric dy G Vy , 

min-ext((iy, a) < 3(dy) < Q x min-extfdy , q); 

Y^X / r-y J y^x 

and all coefficients Ppq are nonnegative. 

The definition of the metric vertex sparsifier is equivalent to the definition of the flow vertex 
sparsifier. We prove this fact in Lemma 13.51 and Lemma I A . 1 1 using duality. However, we shall use 
the term "metric vertex sparsifier" , because the new definition is more convenient for us. Also, the 
notion of metric sparsifiers makes sense when we restrict dx and dy to be in special families of 
metrics. For example, metric sparsifiers are equivalent to cut sparsifiers. 

Remark 3.1. The constraints that all (pipjq and (3pq are nonnegative though may seem unnatural 
are required for applications. We note that there exist linear operators (j) ■ Vy — )■ Vx and linear 
functional (3 : Vy — )■ M that satisfy all constraints above except for the non-negativity constraints. 
However, even if we drop the non-negativity constraints, then there will always exist an optimal met- 
ric sparsifier with nonnegative constraints (the optimal metric sparsifier is not necessarily unique). 
Surprisingly, the same is not true for metric extension operators: if we drop the non-negativity 
constraints, then, in certain cases, the optimal metric extension operator will necessarily have some 
negative coefficients. This remark is not essential for the further exposition, and we omit the proof 
here. 
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Lemma 3.3. Let X be a set of points, Y C X , and aij be a nonnegative set of weights on pairs 
{i,j) £ X X X. Suppose that cj) : Dy — ^ T^x is a Q-distortion metric extension operator. Then 



Proof. The lower bound 



min-ext(dy, a) < a((j)(dY)). 
Y^x 



min-extfdy , a) < a(dx] 
Y~^x 



holds for every extension dx (just by the definition of the minimum metric extension), and partic- 
ularly for dx = (pidY)- n 

We now show that given an extension operator with distortion Q, it is easy to obtain Q-quality 
metric sparsifier. 

Lemma 3.4. Let X be a set of points, Y G X , and aij be a nonnegative set of weights on pairs 
{i,j) G X X X . Suppose that (p : Dy — )■ T>x is a Q-distortion metric extension operator. Then there 
exists a Q- quality metric sparsifier /3 : Vy — )• M. Moreover, given the operator <j), the sparsifier /? 
can be found in polynomial-time. 

Remark 3.2. Note, that the converse statement does not hold. There exist sets X , Y C X and 
weights a such that the distortion of the best metric extension operator is strictly larger than the 
quality of the best metric vertex sparsifier. 

Proof. Let fi{dy) = X]i jex Oiij4'{dy){i, j). Then by the definition of Q-distortion extension opera- 
tor, and by Lemma [3^ 



min-ext(dy , a) < 0(dy) = a((j)(dy)) < Q x min-extfdy , a) 

Y^X i-\ ' VTV // 



If 4> is given in the form (JT]) , then 



~ ^ 

ijex 

□ 



We now prove that every Q-quality metric sparsifier is a Q-quality fiow sparsifier. We prove 
that every Q-quality flow sparsifier is a Q-quality metric sparsifier in the Appendix. 

Lemma 3.5. Let G = {V, a) be a weighted graph and let U G V be a subset of vertices. Suppose, 
that a linear functional (3 : T>ij — )■ M, defined as 

/3{du) = ^ Ppqdu{p,q) 

p,q&U 

is a Q-quality metric sparsifier. Then the graph H = (U, /3) is a Q-quality fiow sparsifier of G. 
Proof. Fix a set of demands {(s^, tr; dem^)}. We need to show, that 

max-flow(G, {(sr, trj dem^)}) < max-flow(i7, {(s^, iri dem^)}) <Qx max-flow(G, {(sr, tr; demr)}). 

The fraction of concurrently satisfled demands by the maximum multi-commodity fiow in G 
equals the maximum of the following standard linear program (LP) for the problem: the LP has a 



7 



variable Wp for every path between terminals that equals the weight of the path (or, in other words, 
the amount of flow routed along the path) and a variable A that equals the fraction of satisfied 
demands. The objective is to maximize A. The constraints are the capacity constraints ^ and 
demand constraints (j4]). The maximum of the LP equals the minimum of the (standard) dual LP 
(in other words, it equals the value of the fractional sparsest cut with non-uniform demands). 



minimize: 



^ aijdv{i,j) 
i,jev 

subject to: 

''^^dy^Srjtr) X dcm^ > 1 
r 

dv G 'C'v i-e., dv is a metric on V 



The variables of the dual LP are dv{i,j), where i,j E V. Similarly, the maximum concurrent 
flow in H equals the minimum of the following dual LP. 



minimize: 

p,qGU 

subject to: 

^^d;7(Sr,ir) X dem^ > 1 
r 

du G Vu i.e., du is a metric on U 



Consider the optimal solution of the dual LP for H. Let dy be the minimum extension of 
d^. Since dy is a metric, and dy{sritr) = dlj{sr,tr) for each r, dy is a feasible solution of the the 
dual LP for G. By the definition of the metric sparsifier: 

Pidu) = ^ Ppqdu{p,q) > mm-ext(d^,a) = ^ aijdy{i,j). 

p,q£U ijGiV 

Hence, 

max-flow(/f, {(sr, tr, dem^)}) > max-flow(G, {(sr, t^, dem^)}). 

Now, consider the optimal solution dy of the dual LP for G. Let be the restriction of dy{p, q) 
to the set U. Since d^ is a metric, and dlj{sr,tr) = dy{sr,tr) for each r, d^ is a feasible solution 
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of the the dual LP for H. By the definition of the metric sparsifier (keep in mind that dy is an 
extension of d^), 



l^i^u) = ^ Ppqdu{jp,q) <Q X min-ext((i^,Q;) <Q x ^ aijdy{i,j). 




Hence, 



max-flow(//, {(sr, tr, dem^)}) <Qx max-flow(G, {(sr, ir, dem^)}). 



□ 



We are now ready to state the following result. 

Theorem 3.6. There exists a polynomial-time algorithm that given a weighted graph G = (y, a) 
and a k-vertex subset U <ZV , finds a O (log k / loglog k)- quality flow sparsifier H = (U,P). 

Proof. Using the algorithm given in Theorem 14.51 we find the metric extension operator (j) : Dy 
T>x with the smallest possible distortion. We output the coefficients of the linear functional /3{dY) = 
a{(p{dY)) (see Lemma [3^ . Hence, by Theorem 14. 31 the distortion of (j) is at most 0(log k/ log log k). 
By Lemma 13.41 (3 is an 0(log fc/ log log /i:)-quality metric sparsifier. Finally, by Lemma 13.51 /3 is a 
0(log A;/ log log /c)-quality flow sparsifier (and, thus, a 0(log fc/ log log fc)-quality cut sparsifier). 



4 Algorithms 

In this section, we prove our main algorithmic results: Theorem 14.31 and Theorem 14.51 Theorem 14.31 
asserts that metric extension operators with distortion 0(log A;/ log log fc) exist. To prove Theo- 
rem |431 we borrow some ideas from the paper of Moitra (2009). Theorem 14.51 asserts that the 
optimal metric extension operator can be found in polynomial-time. 

Let $y_j.x be the set of all metric extension operators (with arbitrary distortion). That is, 
^Y^x is the set of linear operators (j) : Py — )• Vx with nonnegative coefficients (pipjg (see ([T])) that 
map every metric dy on Py to an extension of dy to X. We show that ^y->x is closed and convex, 
and that there exists a separation oracle for the set ^y^x- 

Corollary 4.1 (Corollary of Lemma 14.21 (see below)). 

1. The set of linear operators ^y-^x is closed and convex. 

2. There exists a polynomial-time separation oracle for ^y^x- 

Lemma 4.2. Let A C M™ and B C M" be two polytopes defined by polynomially many linear 
inequalities (polynomially many in m and n). Let ^a-^B the set of all linear operators (j) : — t- 
M", defined as 



□ 




p 



that map the set A into a subset of B. 



1. Then ^a-^b is a closed convex set. 
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2. There exists a polynomial-time separation oracle for ^j^^s ■ That is, there exists a polynomial- 
time algorithm (not depending on A, B and ^j^^^b); that given linear constraints for the sets 
A, B, and the n x m matrix (j)*^ of a linear operator (p* : R™ — )• M" 

• accepts the input, if 0* € ^a^B ■ 

• rejects the input, and returns a separating hyperplane, otherwise; i.e., if (j)* ^ <I>_4_>b, 
then the oracle returns a linear constraint I such that 1(4'*) > 0, but for every 4> £ ^a-^b, 
l{4>) < 0. 

Proof If (/>*, (j)** G <^A^B and A G [0, 1], then for every a e A, (t)*{a) G B and (t)**{a) G B. Since B 
is convex, A0*(a) + (1 - A)0**(a) G B. Hence, {X^* + (1 - A)0**)(a) G B. Thus, is convex. If 

is a Cauchy sequence in ^a^B-, then there exists a hmit (j) = Umfc_>oo 0^^^^ and for every a G .A, 
0(a) = Ymik^^ (j)'^^\a) G i3 (since B is closed). Hence, is closed. 

Let Cb be the set of linear constraints defining B: 

B = {heW : lib) = kh + < for all I G Cb}. 

i 

Our goal is to find "witnesses" a e A and I G Cb such that /((/>* (a)) > 0. Note that such a and I 
exist if and only if 0* ^ For each I e Cb, write a linear program. The variables of the program 
are ap, where a G W^. 



maximize: l{(p{a)) 
subject to: a & A 



This is a linear program solvable in polynomial-time since, first, the objective function is a 
linear function of a (the objective function is a composition of a linear functional I and a linear 
operator (p) and, second, the constraint a G ^ is specified by polynomially many linear inequalities. 

Thus, if 0* ^ then the oracle gets witnesses a* e A and I* G Cb, such that 

r(r(a*)) = ^^/*</'*pap + /o>0. 

i p 

The oracle returns the following (violated) linear constraint 

r(</.(a*)) = YY1 ^i't'^p'^p + ^0 < 0. 

i P 

□ 

Theorem 4.3. Lei X 6e a set of points, and Y be a k-point subset of X. For every set of 
nonnegative weights aij on X x X, there exists a metric extension operator (j) : Vy — >■ with 
distortion 0(log k/ log log k) . 

Proof. Fix a set of weights aij. Let Vy = {dy G V : min-exty-^.j!f(c?y, a) < !}• We shall show that 
there exists cf) G $y_>x, such that for every dy G Vy 
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then by the hnearity of <f), for every dy S T^y 

— ^ I min-extfdy, a). (5) 

log log k ) Y^x 

The set Vy is convex and compact, since the function min-exty_>.x(c?y , «) is a convex function 
of the first variable. The set $y_>.x is convex and closed. Hence, by the von Neumann (1928) 
minimax theorem, 

min max > aij ■ (f){dY){i, j) = max min > aij ■ (l){dY){i, j)- 

We will show that the right hand side is bounded by 0(log /c/ log log A:), and therefore there exists 
<j) E $y^x satisfying ([5]). Consider dy G T^y for which the maximum above is attained. By 
Theorem 12.71 (FHRT 0-extension Theorem), there exists a 0-extension f : X ^ Y such that 
f{p) = P for every p gY, and 

y an ■ d^{f{i),f{j)) < O ( ^ ^°f^ \ mm-ext{d^,a) < O ( ^ ^°f^ \ . 
u Y\J\j^j\j;j- \^iogiogA;y Y^x ^ ^' \\oglogk J 

Define (j)'^{dY){i,j) = dyifii)^ /(j))- Verify that (/>*(dy) is a metric for every dy E Vy- 
. r(dy)(.,j)=dy(/(i),/(j))>0; 

. ridY)iiJ)+r{dY){j,k)-ridY){hk)=dYif{i)Jij))+dY{f{j)Jik))-dYifii^ 

Then, for p,q £ Y, (j)*{dY)ip,q) = dy {f (p) , f (q)) = dY{p,q), hence 4)*{dY) is an extension of dy. 
All coefficients (pipjq of 0* (in the matrix representation ([1])) equal or 1. Thus, (p* G ^y^x- Now, 

an . <t>*{d*Y){^,J) = ■ dyimJij)) < O (t"^) ■ 

This finishes the the proof, that there exists (j) ^ ^Y~>x satisfying the upper bound □ 

Theorem 4.4. Let X, Y , k, and a he as in Theorem \4-3\ Assume further, that for the given a 
and every metric dy G Py, there exists a 0-extension f : X ^ Y such that 

^ aij ■ dy{f{i),f{j)) <Q X mm-^t(dy,a). 

Then there exists a metric extension operator with distortion Q. Particularly, if the support of the 
weights a^ is a graph with an excluded minor K^^r, then Q = 0{r'^). If the graph G has genus g, 
then Q = Oilogg). 

The proof of this theorem is exactly the same as the proof of Theorem 14. 3i For graphs with 
an excluded minor we use a result of Calinescu, Karloff, and Rabani (2001) (with improvements 
by Fakcharoenphol, and Talwar (2003)). For graphs of genus g, we use a result of Lee and Sidiropou- 
los (2010). 
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Theorem 4.5. There exists a polynomial time algorithm that given a set of points X, a k-point 
subset Y C X, and a set of positive weights Uij, finds a metric extension operator (p : Dy — ^ T^x 
with the smallest possible distortion Q. 

Proof. In the algorithm, we represent the Unear operator (j) as & matrix (jjipjq (s^e ([I])). To find 
optimal (p, we write a convex program with variables Q and (pipjq: 



minimize: Q 
subject to: 



a((/)((iy)) <Qx min-ext(dy , a) 



for all dy G 'Dy 



Y^X 



(6) 
(7) 



The convex problem exactly captures the definition of the extension operator. Thus the solution 
of the program corresponds to the optimal Q-distortion extension operator. However, a priori, it 
is not clear if this convex program can be solved in polynomial-time. It has exponentially many 
linear constraints of type ([6]) and one convex non-linear constraint ([7]). We already know (see 
Corollarv 14. ip that there exists a separation oracle for <j) S $y_>x- We now give a separation oracle 
for constraints ([6]). 

Separation oracle for ([6]). The goal of the oracle is given a linear operator 0* : i— )■ 
Yip q'PipjqdYijPiQ) and a real number Q* find a metric dy G Py, such that the constraint 

a((/)*((iy)) <Q* X min-ext((iy, a) (8) 

y— )-x 

is violated. We write a linear program on dy. However, instead of looking for a metric dy G T)y 
such that constraint ([8]) is violated, we shall look for a metric dx G T>x, an arbitrary metric 
extension of dy to X, such that 

a{(l)*{dy)) = ^ aij ■ (l)*{dy){i,j) > Q* x ^ aijdxiij). 

i,jeX i,j&X 

The linear program for finding dx is given below. 



maximize: 

oiij ■ (pipjqdxiPjQ) Q* X ^ OLijdx{i,j) 

i,j&X p,q& i,j&X 

subject to: dx G T>x 



If the maximum is greater than for some d*^, then constraint ([8|) is violated for dy = d^y (the 
restriction of d%^ to Y), because 

mm-ext((iy,a) < ^ aijd*x{i,j). 
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If the maximum is or negative, then ah constraints ([6]) are satisfied, simply because 
min-ext((iy , a) = min > o.ijdx{i,j)- 

Y^X dx -dx is extension of dt^ ^— ' 

□ 

5 Lipschitz Extendability 

In this section, we present exact bounds on the quahty of cut and metric sparsifiers in terms of 
Lipschitz extendability constants. We show that there exist cut sparsifiers of quahty ek{li,ii) and 
metric sparsifiers of quahty efc(oo, ^oo ©i • • • ©i ^oo), where ek{ii,h) and ek{oo, ^oo ©i • • • ©i ioo) are 
the Lipschitz extendabihty constants (see below for the definitions). We prove that these bounds are 
tight. Then we obtain a lower bound of r2(Y^log /c/ log log k) for the quality of the metric sparsifiers 
by proving a lower bound on efc(oo,£oo ©i • • • ©i ^oo)- In the first preprint of our paper, we also 
proved the bound of Q{ y^log k/ log log k) on efc(£i,£i). After the preprint appeared on arXiv.org, 
Johnson and Schechtman notified us that a lower bound of r2(-y/log A;/ log log k) on ek{ii,ii) follows 
from their joint work with Figiel (Figiel, Johnson, and Schechtman 1988). With their permission, 
we present the proof of this lower bound in Section [D] of the Appendix. This result implies a lower 
bound of r2(\/log /c/ log log k) on the quality of cut sparsifiers. 

On the positive side, we show that if a certain open problem in functional analysis posed by Ball 
(1992) (see also Lee and Naor (2005), and Randrianantoanina (2007)) has a positive answer then 
efc(^i,^i) < 0(-v/IogA;); and therefore there exist 0(Vlog A;)-quality cut sparsifiers. This is both 
an indication that the current upper bound of 0(log Ar/loglog/c) might not be optimal and that 
improving lower bounds beyond of 0{^/\og k) will require solving a long standing open problem 
(negatively) . 

Question 1 ( Ball (1992); see also Lee and Naor (2005) and Randrianantoanina (2007)). Is it true 
that ek{i.2Ai) is bounded by a constant that does not depend on k? 

Given two metric spaces {X,dx) and (y, dy), the Lipschitz extendability constant ek{X,Y) is 
the infimum over all constants K such that for every k point subset Z of X, every Lipschitz map 
/ : Z — )• y can be extended to a map f : X ^ Y with ||/||Lip < We denote the supremum 

of ek{X,Y) over all separable metric spaces X by efc(oo,y). We refer the reader to Lee and Naor 

(2005) for a background on the Lipschitz extension problem (see also Kirszbraun (1934), McShane 
(1934), Marcus and Pisier (1984), Johnson and Lindenstrauss (1984), Bah (1992), Mendel and Naor 

(2006) , Naor, Peres, Schramm and Sheffield (2006)). Throughout this section, £i, £2 and £00 denote 
finite dimensional spaces of arbitrarily large dimension. 

In Section 15. 1^ we establish the connection between the quality of vertex sparsifiers and ex- 
tendability constants. In Section [5^21 we prove lower bounds on extendability constants ek{oo,£i) 
and ek{£i,£i), which imply lower bounds on the quality of metric and cut sparsifiers respectively. 
Finally, in Section [5.31 we show that if Question [1] (the open problem of Ball) has a positive answer 
then there exist 0{\/log A;)-quality cut sparsifiers. 

5.1 Quality of Sparsifiers and Extendabifity Constants 

Let <3|"* be the minimum over all Q such that there exists a Q-quality cut sparsifier for every graph 
G = {V, a) and every subset U C V of size k. Similarly, let Q^^^"'^ be the minimum over all Q such 



13 



that there exists a Q-quaUty metric sparsifier for every graph G = {V, a) and every subset U (Z V 
of size k. 



Theorem 5.1. There exist cut sparsifiers of quality ek{£i,ii) for subsets of size k. Moreover, this 
bound is tight. That is, 



Proof. Denote Q = ek{ii,ii). First, we prove the existence of Q-quahty cut sparsifiers. We 
consider a graph G = (V, a) and a subset U C V of size k. Recah that for every cut {S, U \ S) 
of U, the cost of the minimum cut extending {S,U \ S) to V is nim-extu^v{Ss,ce), where 6s is 
the cut metric corresponding to the cut {S, U\ S). Let C = {(^s, min-ext!7_).y (^5, a)) G T>u x M : 
6s is a cut metric} be the graph of the function 6s ^ min-ext^z-^y ((55, a); and C be the convex 
cone generated by C (i.e., let C be the cone over the convex closure of C). Our goal is to construct 
a linear form /? (a cut sparsifier) with non-negative coefficients such that x < (3{du) < Qx for every 
{du, x) E C and, in particular, for every {djj, x) G C. First we prove that for every {di,xi), (^2,^2) G 
C there exists /3 (with nonnegative coefficients) such that xi < I3{di) and (3{d2) < Qx2. Since these 
two inequalities are homogeneous, we may assume by rescaling {d2,X2) that Qx2 = Xi. We are 
going to show that for some p and q in U: d2ip, q) < di{p, q) and di{p, q) / 0. Then the linear form 

satisfies the required conditions: I3{d\) = xi; P{d2) = xid2{p, q) / di{p, q) < xi = Qx2. 

Assume to the contrary that that for every p and q, di{p, q) < d2{p, q) or di(p, q) = d2{p, q) = 
0. Since {dt{p,q),Xt) G C for t G {1,2}, by Caratheodory's theorem {dt{p,q),Xt) is a convex 
combination of at most dimC + 1 = (2) + 2 points lying on the extreme rays of C. That is, there 
exists a set of nit < (2) + 2 positive weights fif such that dt = ^5 f^-t^Si where 6s G Vu is the cut 
metric corresponding to the cut {S,U \ S), and xt = //f min-ext;7_>.y((55', a). We now define 
two maps fi : U ^ M"*i and f2'-V^ M"*^ Let /i(p) G W^'^ be a vector with one component 
flip) for each cut [S, U\S) such that > 0. Define /f (p) = //f if p G S*; /^(p) = 0, otherwise. 
Similarly, let f2{i) G M™^ be a vector with one component f2{i) for each cut {S,U \ S) such 
that /Ltf > 0- Let {S* ,V \ S*) be the minimum cut separating S and U \ S va. G. Define fii^) 
as follows: /^(i) = /xf if « G S*; f2{i) = 0, otherwise. Note that \\fi{p) - fi{q)\\i = di{p,q) 
and ||/2(p) — /2(9)||i = d2{p,q). Consider a map g = fif-^^ from f2{U) to fi{U) (note that if 
f2{p) = /2('?) then d2{p,q) = 0, therefore, di(p,q) = and flip) = f2{Q)', hence g is well-defined). 
For every p and q with d2{p, q) 7^ 0, 

\W2{p))-g{f2{q))h = \\fl{p)-fl{Q)\\l = di{p,q)<d2{p,q) = ||/2(p) - /2(g) 111- 

That is, 5" is a strictly contracting map. Therefore, there exists an extension of 5 to a map g : 
f2{V) such that 

||5(/2(i)) - 5(/2(j))||i < Q\\f2{i) - /2(i)||i = Qd2ii,j). 

Denote the coordinate of g{f2{i)) corresponding to the cut {S,U \ S) by g^{f2{i))- Note that 
9^{f2{p))/l^i = fi{p)/l^i equals 1 when p G S and when p G U \ S. Therefore, the metric 
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= \g^{f2{i)) — 9^ {f2{j))\/ fJ'i is an extension of the metric Ss{i,j) to V. Hence, 



X aij5*s{i,j) > mm-ext((55,a) 



We have, 



xi = ^fJ'f min-ext((5s,a) < ^ aij6*s{i,j) = J2Y1 ^ii\9^ (M^)) " 9^{f2{j))\ 

S ^ S i,j&V S i,j&V 

= ^ aij\\g{f2{i)) -g{f2{j))\\i < J2 Q'^ijd2ii,j) = Qx2. 

We get a contradiction. We proved that for every (di, xi), ((i2; 2:2) G C there exists /3 such that 
xi < p{di) and p{d2) < Qx2. 

Now we fix a point (di, xi) G C and consider the set B of all linear functionals with nonnegative 
coefficients /3 such that xi < /3(di). This is a convex closed set. We just proved that for every 
{d2,X2) G C there exists (3 £ B such that Qx2 — P{d2) > 0. Therefore, by the von Neumann (1928) 
minimax theorem, there exist (3 £ B such that for every {d2,X2) G C, Qx2 — P{d2) > 0. Now we 
consider the set B' of all linear functionals j3 with nonnegative coefficients such that Qx2 — P{d2) > 
for every {d2,X2) G C. Again, for every (di,xi) G C there exists /3 £ B' such that P{di) — xi > 0; 
therefore, by the minimax theorem there exists /3 such that x < /3{du) < Qx for every {d,x) G C. 
We proved that there exists a Q-quality cut sparsifier for G. 

Now we prove that if for every graph G = {V, a) and a subset U C V of size k there exists a 
cut sparsifier of size Q (for some Q) then ek{ii,ii) < Q. Let ?7 C ^1 be a set of points of size k and 
f : U —7- £1 be a 1-Lipschitz map. By a standard compactness argument (Theorem IB.1|) . it suffices 
to show how to extend / to a Q-Lipschitz map f : V ^ ii for every finite set V: U C V G ii- 
First, we assume that / maps U to the vertices of a rectangular box {0, ai} x {0, 02} x . . . {0, Ur}. 
We consider a graph G = {V, a) on V with nonnegative edge weights Uij. Let (U, /3) be the optimal 
cut sparsifier of G. Denote di{p,q) = \\p — q\\i and d2{p,q) = \\f{p) — f{<l)\\i- Since / is 1-Lipschitz, 
di{p,q) > d2{p,q). 

Let Si = {p £ U : fi{p) = 0} (for 1 < i < r). Let 5? be the minimum cut separating Si and 
U\Si in G. By the definition of the cut sparsifier, the cost of this cut is at most f3{5si)- Define an 
extension / of / by fi{v) = if f G 5* and fi{v) = ai otherwise. Clearly, / is an extension of /. 
We compute the "cost" of /: 

r r 

X aujfiu) - fiv)\\i = E E - ^ Y.f^^'^^^sd = < /3(di). 

u,v^V i=l u,v£V i=l 

(in the last inequality we use that di{p,q) > d2{p,q) for p,q £ U and that coefficients of (3 are 
nonnegative). On the other hand, we have 



EaMi)||^i — '^lli ^ min-ext((ii, a) > (3{di)/Q. 
TJ — il/ 



We therefore showed that for every set of nonnegative weights a there exists an extension / of / 
such that 

auv\\u-v\\i. (9) 
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Note that the set of ah extensions of / is a closed convex set; and — /(i')lli is a convex 

function of /: 

||(/l + /2)(U) - (/l + /2)W||l < - h{v)\\i + ||/2(n) - f2{v)\\l. 

Therefore, by the Sion (1958) minimax theorem there exists an extension / such that inequahty ([9]) 
holds for every nonnegative Oij. In particular, when auv = 1 and all other au'v' = 0, we get 

\\f{u)-fiv)h<Q\\u-v\\i. 

That is, / is Q-Lipschitz. 

Finally, we consider the general case when the image of / is not necessarily a subset of {0, ai} x 
{0,02} X ...{0,ar}. Informally, we are going to replace / with an "equivalent map" g that maps 
U to vertices of a rectangular box, then apply our result to g, obtain a Q-Lipschitz extension g of 
/, and finally replace g with an extension / of /. 

Let fi{p) be the i-th coordinate of f{p). Let 61, . . . , 65. be the set of values of fi{p) (for p £ U). 
Define map ipi : — )• as tpi{bj) = (61,62 — bi,...,bj — 0, . . . , 0). The map 
ipi is an isometric embedding of {bj} into (IR*% || • ||i). Define map (pi from (M*', || • ||i) to M as 
(j)i{x) = Ylt=i -^t- Then (pi is 1-Lipschitz and (j)i{ipi{bj)) = bj. Now let 

r 

9{p) = MMp)) ® Mf2{p)) ® • • • e Mfrip)) G ©M'^N 

i=l 

4>{yi e • • • e 2/r) = <i)i{yi) e ^2(^2) e • • • e Myr) e Pi 

(where r is the number of coordinates of /). Since maps tpi are isometrics and / is 1-Lipschitz, g 
is 1-Lipschitz as well. Moreover, the image of is a subset of vertices of a box. Therefore, we can 
apply our extension result to it. We obtain a Q-Lipschitz map g : V ^ ©[=1 1^''*- 
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Note also that (j) is 1-Lipschitz and (t){g{p)) = f{p)- Finally, we define f{u) = (j){g{u)). We have 
II /II Lip < ll^ll Lip II 011 Lip < <3- This concludes the proof. □ 

Theorem 5.2. There exist metric sparsifiers of quality 6^(00, ^00 ®i • • • ©1 ^00) for subsets of size k 
and this bound is tight. Since £1 is a Lipschitz retract 0/^00 ©1 ■ ■ -©i^oo (the retraction projects each 
summand Li = ioo to the first coordinate of Li), ek{oo,ioo ©1 • • • ©1 ioo) > ejt(oo,^i). Therefore, 
the quality of metric sparsifiers is at least ek{oo,£i) for some graphs. In other words, 

Q^etric ^ eki^Joo ©1 • • • ©1 ^oc) > efc(oO,4). 
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Proof. Let Q = efc(oo,^oo ®i • • • ®i ^oo)- We denote the norm of a vector w G ^oo ©i • • • ©i ^oo by 
= ||f ll^ooei-'-ei^oo- First, we construct a Q-quahty metric sparsifier for a given graph G = (y,a) 
and U C V of size k. 

Let C = {((i(7, min-ext(7^.v/(d[/, a)) : dfj G Vfj} and C be the convex huh of C. We construct 
a hnear form /3 (a metric sparsifier) with non- negative coefficients such that x < /3{dij) < Qx for 
every {du,x) £ C. 

The proof follows the lines of Theorem 15.11 The only piece of the proof that we need to modify 
slightly is the proof that the following is impossible: for some {di,xi) and {d2,X2) in C, xi = Qx2 
and for all p,q £ U either di{p,q) < d2{p,q) or di{p,q) = d2{p,q) = 0. Assume the contrary. We 
represent {di,x) as a convex combination of points {d\,x\) in C (by Caratheodory's theorem). Let 
fi be an isometric embedding of the metric space {U,d\) into £oo- Then / = (Bifi is an isometric 
embedding of {U, di) into £00 ©i • • • ©i ^oo- Let be the minimum extension of d2 to V. Note that 
/ is a strictly contracting map from {U, ^2) to ^00 ©1 • • • ©1 ^oo^ 

Wfip) - fiq)\\oo = Yl Wf^iP) - /«(5)lloo = Y.d\{P,l) = diiP,Q) < d2ip,q), 

i i 

for all p,q £ U such that d2{p, q) > 0. Therefore, there exists a Lipschitz extension of / : {U, ^2) — ^ 
^oo©i • • -©i^oo to / : {V, dl) 4o©i • • -©1(00 withjl/lliip < Q. Let fiiV cloche the projection 
of / to the i-th. summand. Let d\{x,y) = \\fi{x) — fi{y)\\oo be the metric induced by fi on G. Let 

diix,y) = ||/(x) -/(y)ll^ = ^||/,(x) -/i(y)|U = ^cil(x,y) 

i i 

be the metric induced by / on G. Since fi{p) = fiip) for all p £ U, metric d\ is an extension of d[ 
to V. Thus a{d\) > min-ext u^v{d\, a) = x\. Therefore, a{di) = a{'^d\) > X^i ^1 — ^i- Since 
Wfhip < Q, di(.x,y) = ||/(x)-/(y)||oo < Qd*2{x,y) (for every x,y£V such that d^(x,y) > 0). We 
have, 

a{di) < a{Qd2) = Q niin-ext((i2, a) < Qx2 = xi. 

We get a contradiction. 

Now we prove that if for every graph G = {V, a) and a subset U C V of size k there exists a 
metric sparsifier of size Q (for some Q) then e(oo,^oo©i • • -©i^oo) < Q- Let {V,dv) be an arbitrary 
metric space; and U C ^ be a subset of size k. Let / : (^7, dv\u) — ^ ^00 ©1 • • • ©1 ^00 be a 1-Lipschitz 
map. We will show how to extend / to a Q-Lipschitz map / : {V,dv) — ^00 ©1 • • • ©1 ^oo- We 
consider graph G = {V, a) with nonnegative edge weights and a Q-quality metric sparsifier /3. 

Let /j :[/—)• ^00 be the projection of / onto its i-th summand. Map fi induces metric d*(p, q) = 
\\fi{p) — /i(^)|| on U. Let be the minimum metric extension of to V; let (i*(x, y) = (i*(x, y). 
Note that since / is 1-Lipschitz 

MP,q) = Y.d\p,q) = Whip) - Mq)W = Wfip) - f{Q)W < dv{p,q) 

i i 

for p,q £ U. Therefore, 

ail) = Y^id') < = < l^iMu) < Q^idv) 

i i 

(we use that all coefficients of /3 are nonnegative). 



17 



Each map fi is an isometric embedding of {U,(f) to £00 (by the definition of (f). Using the 
McShane extension theorenjl (McShane 1934), we extend each fi a 1-Lipschitz map fi from {V, (t) 
to £00 • Finally, we let / = (Bifi- Since each fi is an extension of fi, f is an extension of /. For 
every x,y eV, we have ||/(x) - f{y)\\ = Y,i \\fi{x) - fi{y)\\ = d*{x,y). Therefore, 

^ axy\\f{x) - /(y)|| = a(J*) < Qa{dv) = <3 x X] Oixydv(x,y). 

We showed that for every set of nonnegative weights a there exists an extension / such that the 
inequality above holds. Therefore, by the minimax theorem there exists an extension / such that 
this inequality holds for every nonnegative axy In particular, when axy = 1 and all other ax'y' = 0, 
we get 

\\f{x)-f{y)\\<Qdv{x,y). 
That is, / is Q-Lipschitz. □ 

Remark 5.1. We proved in Theorem l5j\ that Qf^ = efc(£f ,£f ) for {^) + 2 < M,N < 00; by 
a simple compactness argument the equality also holds when either one or both of M and N are 
equal to infinity. Similarly, we proved in Theorem \5.2\ that Qi^^^"'^ = ek{oo,i^ ®i • • • ®i i^) for 

N 

k — 1 < M < 00 and (2) + 2 < < 00; this equality also holds when either one or both of M and 
N are equal to infinity. (We will not use use this observation.) 



5.2 Lower Bounds and Projection Constants 

We now prove lower bounds on the quality of metric and cut sparsifiers. We will need several 
definitions from analysis. The operator norm of a linear operator T from a normed space C/ to a 
normed space V is ||T|| = ||T||{/_>.y = sup„_^o 1 1 1 1 v/ 1 1 1 1 (7- The Banach-Mazur distance between 
two normed spaces U and V is 

dBAi{U,V) = inf{||T||[/_j.v'||T~^||v^[/ : T is a linear operator from U to V}. 

We say that two Banach spaces are C-isomorphic if the Banach-Mazur distance between them is 
at most C; two Banach spaces are isomorphic if the Banach-Mazur distance between them is finite. 
A linear operator P from a Banach space y to a subspace L C ^ is a projection if the restriction 
of P to L is the identity operator on L (i.e., P\l = II)- 

Given a Banach space V and subspace L C we define the relative projection constant A(L, V) 
as: A(L, V) = inf{||P|| : P is a linear projection from V to L}. 

Theorem 5.3. 

Qr*""^ = ^(Vlogfc/loglogA:). 

Proof. To establish the theorem, we prove lower bounds for ek{ioo,ii)- Our proof is a modifi- 
cation of the proof of Johnson and Lindenstrauss (1984) that ek{ii,h) = r2(\/log /c/ log log k). 
Johnson and Lindenstrauss showed that for every space V and subspace L C V oi dimension 
d = [c log /c/log log A;J , ek{V,L) = ^1{X{L,V)) (Johnson and Lindenstrauss (1984), see Appendix ICj 
Theorem lC.il for a sketch of the proof). 

^The McShane extension theorem states that efe(M, R) — 1 for every metric space M. 
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Our result follows from the lower bound of Griinbaum (1960): for a certain isometric embedding 
ofiimtoig, X{£f,l^) = eiVd) (for large enough iV). Therefore, ek{e^,ef) = r?(v/log A;/ log log A;). 

□ 

We now prove a lower bound on Q^"*. Note that the argument from Theorem 15.31 shows 
that Ql"* = ek{li,li) = Q{X{L,ii)), where L is a subspace of isomorphic to if. Bourgain 
(1981) proved that there is a non-complemented subspace isomorphic to i"^ in Li. This implies 
that X{L,£^) (for some L) and, therefore, Q^"* are unbounded. However, quantitatively Bourgain's 
result gives a very weak bound of (roughly) log log log k. It is not known how to improve Bourgain's 
bound. So instead we present an explicit family of non-^i subspaces {L} of ii with X{L,ii) = 
e{Vdi^) and dBMiLjf'^^) = O(^di^). 

Theorem 5.4. 

gr*>^^(\/logA;/loglogfc). 

We shall construct a d dimensional subspace L oi , with the projection constant X{L,£i) > 
il(\/d) and with Banach-Mazur distance d{L,£f) < O(^). By Theorem [OT] (as in Theorem 15. 3D . 
efc(£i,L) > Q{^/d) for d = [c log A;/ log log A;J . The following lemma then implies that ek{£iAi) ^ 
O(v^). 

Lemma 5.5. For every metric space X and finite dimensional normed spaces U and V, 

ek{X,U) < ek{X,V)dBM{U,V). 

Proof. Let T : U — F be a linear operator with ||T||||T^^|| = dBM{U,V). Consider a A;-point 
subset Z C X and a Lipschitz map f : Z ^ U. Then g = Tf is a Lipschitz map from Z to V. Let 
g be an extension of 5 to X with ||g||Ljp < efe(X, F)||(7||2,jp. Then / = T^^g is an extension of / 
and 

Wfhip < \\T-'\\\\~g\\Lip < \\T-'\\ ■ ek{X,V) ■ Mnp 

< \\T-^\\ ■ ek{X,V) ■ ||r||||/||L,p = ek{X,V)dBM{U,V)\\f\\up. 

□ 

Proof of Theorem \5.4\ Fix numbers m > and d = . Let 5 C M*^ be the set of all vectors in 
{— 1, 0, 1}*^ having exactly m nonzero coordinates. Let /i, . . . , be functions from 5 to M defined 
as fi{S) = Si {Si is the i-th coordinate of S). These functions belong to the space V = Li{S,fi) 
(where /x is the counting measure on S). The space V is equipped with the Li norm 

ii/iii = E 1/(^)1; 

and the inner product 

{f,g) = Y,f{S)g{S). 
The set of indicator functions {esjsg^ 



esiA) 



1, iiA = S; 
0, otherwise 
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is the standard basis in V. 

Let L C V he the subspace spanned by fi, . . . , fd- We prove that the norm of the orthogonal 
projection operator : y — )■ L is at least and then using symmetrization show that P-^ 

has the smallest norm among all linear projections. This approach is analogues to the approach 
of Griinbaum (1960). 

All functions /j are orthogonal and II /ill 2 = |5|/m (since for a random S" G 5, Pr (/j(S') G {il}) = 
1/m). We find the projection of an arbitrary basis vector (where A G S) on L, 



r)±( N {eA,fi) f {eA,fi) ,f > 



1=1 



1=1 Bes 



1^ Y{e.A,fi)Ut^e.B) es. 

I I B£S \i=l / 



Hence, 



Notice, that 



m X - 

BG5 



Y{eAji){fi,eB) 



1=1 



(10) 



Y,{^Aji){fueB) = Y.AiBi = {A,B) 



i=l 



i=l 



For a fixed A £ S and a random (uniformly distributed) B £ S the probability that A and B overlap 
by exactly one nonzero coordinate (and thus |(j4, S)| = 1) is at least 1/e. Therefore (from pO|) ). 

\\P^{eA)\\i>n{m) = n{Vd), 

and IIP^II > ||P^(eA)||i/||eA||i > n{Vd). 

We now consider an arbitrary linear projection P : L ^ V. We shall prove that 

J^||P(eA)||i-||P^(eA)||i>0, 
AGS 

and hence for some ca, 11^(6^)111 > ||P-'"(eyi)||i > i^{Vd). Let aAB = sgn((P-'-(eyi), e^)) = 
sgn{{A,B)). Then, 

\\P^ieA)\\i = \{P^ieA),eB)\ = Yl ^AB{P^ieA),eB), 
Bes Bes 



and, since aAB £ [—1, 1], 



\PieA)\\i = Y \iP(^A),eB)\ > Y <yAB{P{eA).eB). 



BdS 



Bes 



Therefore, 



Y \\PieA)\\i - \\P^{eA)\\i >YY '^ABiPieA) - P^{eA),eB). 



AdS 



AaSB&S 
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Represent operator P as the sum 

d 

P{g)=P^{g)+J2M9)n, 

i=l 

where '0j are hnear functional^ with ker tl^i D L. We get 

d 

J2 ^ ^AB{P{eA) - P'^ieA), es) = ^^^i^ MeA)fi, es) 

A&S B&S AeS BeS i=l 

i=i \Aes Bes J 

We now want to show that each vector 

5i = X] X] <yAB{eB-,fi)eA 
AeSBeS 

is coUinear with /j, and thus gi £ L C ker^'i and tpi{gi) = 0. We need to compute gi{S) for every 

9i{S) = X] X] ^AB{eB,fi)eA{S) = ^ crsBBi, 
Aes Bes Bes 

we used that eA{S) = 1 if A = 5, and eA{S) = otherwise. We consider a group ^ X ^2 of 
symmetries of S. The elements of H are pairs h = {7r,S), where each vr € is a permutation on 
{l,...,d}, and each G {-'^AV- The group acts on 5 as follows: it first permutes the coordinates 
of every vector S according to vr and then changes the signs of the j-th coordinate if 6j = —1 i.e., 

h : S = {Si, . . . , Sd) ^ hS = ((^1 5^-1(1), . . . , 5d5'^-i(rf)). 

The action of G preserves the inner product between A,B £ S i.e., {hA,hB) = {A,B) and thus 
'^{hA){hB) = (^AB- It is also transitive. Moreover, for every 5,5' G S, if Si = 5-, then there exists 
h £ G that maps 5 to 5', but does not change the i-th coordinate (i.e., 7r(i) = i and 6i = 1). Hence, 
if Si = S'^, then for some h 

gi{S') = gi{hS) = (r{hs)BBi = Y a^hS){hB){hB)i = ^ asB{hB)i = ^ asBBi = gi{S). 
Bes Bes Bes Bes 

On the other hand, gi{S) = —gi{—S). Thus, if Si = —5-, then gi{S) = —gi{S'). Therefore, 
gi{S) = XSi for some A, and gi = Xfi. This finishes the prove that ||P|| > Q{Vd). 
We now estimate the Banach-Mazur distance from if to L. 

Lemma 5.6. We say that a basis fi, ■ ■ ■ , fd of a normed space (L, \\ ■ is symmetric if the norm 
of vectors in L does not depend on the order and signs of coordinates in this basis: 



"^Cifi = \\YSiCn{i)fi 



i=l i=l 



^The explicit expression for ipi is as follows ipiig) ~ (-P(ff) ~ P^{9)j fi)/\\fi\ 
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for every ci, . . . , S M, . . . , 5^ G ^'^'^ £ Srf- 

Lei fi, ■ ■ ■ , fd be a symmetric basis. Then 



ll/l + --- + /d||L 



Proof. Denote by r/i,...?/^ the standard basis of ^f. Define a linear operator T : £f ^ L as 
T{r]i) = fi. Ttien dBM{L,ii) < \\T\\ ■ \\T-'^\\. We have, 

||r|| = max ||T(ci?7i H \- Cdr]d)\\L < max (||r(ciryi)||L H \- \\T{cdr]d)\\L) 

ce^f:||c||i=l cG£f:||c||i = l 

= max\\T{r]i)\\L = max||/i||L = ||/i||l. 
On the other hand, 

(IIT^^II)"^ = min ||r"^(ci?7i H h Cdr]d)\\L = min ||ci/i H h Cd/d||L. 

ce^f;||c||i=l cG£f:||c||i = l 

Since the basis /i, . . . , is symmetric, we can assume that aU Cj > 0. We have, 

d d d 1 

j=l i=l i=l i=l 



□ 



We apply this lemma to the space L and basis fi, ■ ■ ■ , fd- Note that ||/j||i = \S\/m and 



ii/i + --- + /diii = E|E^' 

5g<S i=l 



' C 



Pick a random S £ S. Its m nonzero coordinates distributed according to the Bernoulli distribution, 



thus 



and L equa 



equals in expectation Q{^/rn) and therefore the Banach-Mazur distance between if 

dBM{L,£i) = O X ^ X -jlr^) = O(V^). 

\ m ^/m\o\J 

□ 



5.3 Conditional Upper Bound and Open Question of Ball 

We show that if Question [1] (see page [T3j) has a positive answer then there exist 0( A/log fc)-quality 
cut sparsifiers. 

Theorem 5.7. 



QT' = ek{h,h) < 0{e{£2,h)V^^oglogk). 

Proof. We show how to extend a map / that maps a fc-point subset U of ii to li to a map f : li ^ ii 
via factorization through £2- In our proof, we use a low distortion Frechet embedding of a subset 
of ii into £2 constructed by Arora, Lee, and Naor (2007): 
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Theorem 5.8 (Arora, Lee, and Naor (2007), Theorem 1.1). Let {U,d) be a k-point subspace of 
li. Then there exists a probability measure /x over random non-empty subsets A CU such that for 
every x,y £ U 

E,Mx, A) - diy, A)\Y' = n ( ^^'^^ ) . 

V V log k log log k J 

We apply this theorem to the set U with d{x, y) = ||x — y||i. We get a probability distribution fj. 
of sets A. Let g be the map that maps each x € ii to the random variable d{x, A) in I/2(/i). Since 
for every x and y in ii, E,fj,[\d{x, A) — d{y, A)\'^]^/'^ < E^[||rE — yllf]"'"''^ = \\x — y\\i, the map 5 is a 
1-Lipschitz map from ii to L2(/i). On the other hand. Theorem 15.81 guarantees that the Lipschitz 
constant of g^^ restricted to g{U) is at most O ( y/log k log log k) . 



c 

f 

Now we define a map h : g{U) — t- ii as h{y) = f{g~^{y))- The Lipschitz constant of h is at most 
||/||Lip||fi'~^||Ljp = 0(A/logA:log log k). We extend /i to a map h : L2{fJ,) — ^ ii such that ||/i||Lip < 
ek{h,h)\\h\\Lip = 0{ek{i2,h) \/log k log log k) . We finally define f{x) = h{g{ x)). F or every p G C/, 
hp) = Hgip)) = h{g{p)) = f{p)- ll/IUip < \\h\\Lip\\g\\Lip = 0(efe(£2,4)^/l^loglogA;). This 
concludes the proof. □ 

Corollary 5.9. // Question{l\ has a positive answer then there exist 0{\/Togk) cut sparsifiers. On 
the other hand, any lower bound on cut sparsifiers better than 0(-v^log k) would imply a negative 
answer to Question^ 

Remark 5.2. There are no pairs of Banach spaces {X, Y) for which ek{X, Y) is known to be greater 
than u;{\/\og k) (see e.g. Lee and Naor (2005)). Lf indeed ek{X,Y) is always 0{^/\ogk) then there 
exist 0{\/\ogk)- quality metric sparsifiers. 




6 Certificates for Quality of Sparsification 

In this section, we show that there exist "combinatorial certificates" for cut and metric sparsification 
that certify that Q^"* > Q and Q^^tric > q 

Definition 6.1. A (Q, k)- certificate for cut sparsification is a tuple {G, U, ^1, ^2) where G = (V, a) 
is a graph (with non-negative edge weights a), U <Z V is a subset of k terminals, and fii and fi2 
are distributions of cuts on G such that for some ("scale") c > 

Pr {pe S,q^ S) <c Ft {pe S,q^S) Vp, q e U, 

E^^^j min-ext(55, a) > c - Q ■ E^^^j min-ext((55, a) > 0, 
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where min-extc7_>v'('55, a) is the cost of the minimum cut in G that separates S and U \ S (w.r.t. 
to edge weights a). 

Similarly, a {Q, k)- certificate for metric sparsification is a tuple (G, U, {di}^-^) where G = (V, a) 
is a graph (with non-negative edge weights a), U C V is a subset of k terminals, and {di}^i is a 
family of metrics on U such that 

m m 

min-ext {di,a) > Q min-ext dj, a) > 0. 

i=l i=l 

Theorem 6.2. If there exists a (Q,k)- certificate for cut or metric sparsification, then > Q 
or Q'^^*"'^ > Q, respectively. For every k, there exist {Q'^^ , k)- certificate for cut sparsification, and 
^Qmetric _ k) - Certificate for metric sparsification (for every e > 0). 

Proof. Let {G,U, fii, iJ,2) be a (Q, fc)-certificate for cut sparsification. Let {U,I3) be a (5^"*-quality 
cut sparsifier for G. Then 

Es^^,, min-ext(55, a) < Eg^f,, V l^pg = Y] {pGS,qeU\ S) 

U—>-V ^ — ' ^ — ' 

pes,qeu\s p,qeu 

< c ^ Pr {p£ S,q£U\S) = Es^^^.c ^ /3p, < c • Qf* • %~m2 min-ext(d5, «)• 

P,q& p&S,q&U\S 

Therefore, Qf^ > Q. 

Now, let (G, U, {di}'^^) be a (Q, /c)-certificate for metric sparsification. Let (C/, /3) be a Q^efric_ 
quality metric sparsifier for G. Then 

mm m 

i=l i=l p,q£U P,q&U 1=1 



< Q^^*"^ min-ext (^^di, 

i=l 

Therefore, Q^^tric > q 

The existence of (Q^"*, fc)-certificates for cut sparsification, and {Q]^'^^"^ — e, fe)-certificates for 
metric sparsification follows immediately from the duality arguments in Theorems 15. II and 15.21 We 
omit the details in this version of the paper. □ 
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A Flow Sparsifiers are Metric Sparsifiers 

We have already established (in Lemma 13. 5p that every metric sparsifier is a flow sparsifier. We 
now prove that, in fact, every flow sparsifier is a metric sparsifier. We shall use the same (standard) 
dual LP for the concurrent multi-commodity flow as we used in the proof of Lemma 13.51 Denote 
the sum dy (s,-, tr) dem^ by 7(dy). Then the definition of flow sparsiflers can be reformulated 
as follows: The graph {Y, /3) is a Q-quality flow sparsifler for (X, a), if for every linear functional 
7 : Py — )• R with nonnegative coefficients, 

min Oi{dx) < min /3(c?y) < Q x min a{dx)- 

dxeVxn{dx\Y)>l dYeVY:'Y{dY)>l dxGX>x:7{'^x |y)>l 

Lemma A.l. Let {X,a) be a weighted graph and letY C X be a subset of vertices. Suppose, that 
(Y, 13) is a Q-quality flow sparsifier, then (y, /?) is also a Q-quality metric sparsifier. 
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Proof. We need to verify that for every dy S T^y, 

min-ext ( dy , ct) < didv) < Q x min-extfdy , a). 

Y^X \ J 

Verify the first inequahty. Suppose that it does not hold for some dy G T^y- Let Py = {dy G 
Vy ■ min-exty_i.x(rfy ) a) < /^{dy)}- The set Vy is closed (and compact, if the graph is connected) 
and convex (because min-ext is a convex function of the first variable). Since min-exty ^x{dy, a) > 
P{dy), dy ^ Py. Hence, there exists a linear functional 7 separating dy from T>y. That is, 
lidy) > 1, but for every dy £ Vy, ^{dy) < 1. We show in Lemma [A. 31 that there exists such 7 
with nonnegative coefficients. Then, by the definition of the flow sparsifier, 

min a{dx) < rnin (3{dy). 

dxe'Dxn{dx\Y)>l dYeVY:y(dY)>l 

But, the left hand side 

min a(dx) = min min-extfdy , q) > min min-ext((iy , a) > /3(dy); 

dx(^'Dxnidx\Y)>l dYeVY-MdY)>l Y^X rfy^^y Y-^X 

and the right hand side is at most /3((iy), since '^{dy) > 1. We get a contradiction. 

Verify the second inequality. Let ^{dy) = f3{dy)/ P^dy). By the definition of the flow sparsifier, 

min (i{dy) < Q x min aidx)- 

dye©y:7(dy)>l dxel?x:7(dx |y)>l 

The left hand side is at least /3(c?y) (by the definition of 7). Thus, for every dx & T^x satisfying 
"yidxW) ^ Ij and particularly, for dx equal to the minimum extension of dy, Q x a(dx) > 

P{d*y). □ 

Lemma A. 2 (Minimum extension is monotone). Let X be an arbitrary set, Y C X, and aij be 

a nonnegative set of weights on pairs {i,j) € X x X. Suppose that a metric dy G Py dominates 
metric dy G Vy i.e., dy{p, q) > dyip, q) for every p,q £ Y. Then, 

min-extidy , a) > min-extfdy , a). 
Y^x y-s-x 



Proof sketch. Let d'^ be the minimum extension of dy. Consider the distance function 



d*y*{i,j), ifiJeY; 
d*x{i,j), otherwise. 



The function d*^{i,j) does not necessarily satisfy the triangle inequalities. However, the shortest 
path metric d^-^ induced by d*-^ does satisfy the triangle inequalities, and is an extension of . 
Since, d\{i,j) > d*^{i,j) > d$^{i,j) for every i,j £ X, 



min-ext((iy , a) = a{dx) > ctidx) ^ mm-ext {dy , a). 
Y^x Y^x 



□ 
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Lemma A. 3. Let Vy = {dy G T^y : mm-exty^x(dy , a) < 1}, and dy G T^y \ Vy. Then, there 
exists a linear functional 

with nonnegative coefficients jpq separating dy from T>y, i.e., ^{dy) > 1, but for every dy G Py, 
l{dy) < 1. 

Proof. Let T be the set of linear functionals 7 with nonnegative coefficients such that j{dy) > 1. 
This set is convex. We need to show that there exists 7 G F such that jidy) < 1 for every dy G Vy. 
By the von Neumann (1928) minimax theorem, it suffices to show that for every dy G Py, there 
exists a linear functional 7 G F such that 7(dy ) < 1. By Lemma lA.21 since 

min-extfdv , a) < 1 < min-extfdv, a), 

there exist p,q G Y, such that (p, g) < dy(p, g). The desired linear functional is ^{dy) = 
dy{p,q)/d*y{p,q). □ 



B Compactness Theorem for Lipschitz Extendability Constants 

In this section, we prove a compactness theorem for Lipschitz extendability constants. 

Theorem B.l. Let X he an arbitrary metric space and V he a finite dimensional normed space. 
Assume that for some K and every Z d Z dV with \Z\ = k, \Z\ < 00, every map f : Z ^ V can 
be extended to a map f : Z ^ V so that ||/||Lip < -^ll/Hiip- Then efc(X, F) < K. 

Proof. Fix a set Z and a map f : Z ^ V. Without loss of generality we may assume that 
II /II Lip = 1- We shall construct a iC-Lipschitz extension f : X ^ V oi f. 

Choose an arbitrary zq G Z. Consider the following topological space of maps from X to V: 

T = {h:X -.yxGX \\h{x) - f{zo)\\v < Kd{z^,x)] ^ J] Bv{f{zo),Kd{z^,x)), 

equipped with the product topology (the topology of pointwise convergence); i.e., a sequence of func- 
tions fi converges to / if for every x G A, fi{x) — )• f{x). Note that every ball By{f{zQ),Kd{zo,x)) 
is a compact set. By Tychonoff 's theorem the product of compact sets is a compact set. Therefore, 
F is also a compact set. 

Let M be the set of maps in T that extend /: M = {h d J- : h{z) = f{z) for all z G Z}. Let 
Cx,y (for X, y G X) be the set of functions in T that increase the distance between points x and y 
by at most a factor of Jf: Cx,y = {h £ T : \\h{x) — h{y)\\v < Kd{x,y)}. Note that all sets M and 
Cx,y are closed. We prove that every finite family of sets Cx^y has a non-empty intersection with 
M. Consider a finite family of sets: Cxi,yi, ■ ■ ■ ,Cx„,y„. Let Z = ZU\J^^i{xi,yi}. By the condition 
of the theorem there exists a i^-Lipschitz map f : Z ^ V extending /. Then / G HILi ^^i^Vi 
Therefore, 0^=1 Cx,,y^ n Af / 0. 

Since every finite family of closed sets in {M, Cx,y} has a non-empty intersection and J- is 
compact, all sets M and Cx^y have a non-empty intersection. Let / G Mn Clx yex ^x,y Since 
/ G M, / is an extension of /. Since / G Cx,y for every x,y £ X, the map / is i^-Lipschitz. □ 
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C Lipschitz Extendability and Projection Constants 



In Section [521 we use the following theorem of Johnson and Lindenstrauss (1984). In their paper, 
however, this theorem is stated in a slightly different form. We sketch here the original proof of 
Johnson and Lindenstrauss for completeness. 

Theorem C.l (Johnson and Lindenstrauss (1984), Theorem 3). Let V be a Banach space, L C V 
be a d- dimensional subspace of V, and U be a finite dimensional normed space. Then every linear 
operator T : L ^ U, with ||r||||r-i|| = 0{d), can be extended to a linear operator T : V ^ U 
so that \\T\\ = 0{ek{V,U))\\T\\, where k is such that d < clog fc/log log A; (where c is an absolute 
constant). 

In particular, for U = L, the identity operator II on L can be extended to a projection P : V ^ L 
with \\P\\ < 0{ek{V,L)). Therefore, X{L,V) = 0{ek{V,L)). 

First, we address a simple case when ek{V, U) > \fd. By the Kadec-Snobar theorem there exists 
a projection P/^ from y to L with ||-Pl|| < \fd. Therefore, TP^ is an extension of T with the norm 
bounded by -v/(i||r|| and we are done. So we assume below that e\^(y, U) < Vd 

We construct the extension T in several steps. Denote a = \\T\\\\T^^\\. First, we choose an 
e-net A of size at most /c — 1 on the unit sphere S{L) = {v ^ L : \\v\\v = 1} for e ~ l/(a log^ k) (to 
be specified later). 

Lemma C.2 (Johnson and Lindenstrauss (1984), Lemma 3). If L is a d-dimensional normed space 
and e > then S{L) admits an e-net of cardinality at most (1 + 4/e)'^. 

Let Ti be the restriction of T to j4U {0}. Let SiV) = {v £ V : \\v\\v = 1}- By the definition of 
the Lipschitz extendability constant ek{V,U), there exists an extension T2 : S{V) — )• C/ of Ti with 
||22||Ljp < eA;(y, C/)||ri||ijp < efc(y, [/)||T||. Now we consider the positively homogeneous extension 
Ta : y ^ [/ of T2 defined as 



T3{v) = \\v\\vT2 




The following lemma gives a bound on the norm of T3. 

Lemma C.3 (Johnson and Lindenstrauss (1984), Lemma 2). Suppose that V and U are normed 
spaces, and f : S{V)L){0} U is a Lipschitz map with /(O) = 0. Then the positively homogeneous 
extension f of f is Lipschitz and 

\\f\\Lip<2\\f\\Lip+ sup \\f{v)\\u. 

ves{v) 

Since r2(0) = and mUip < ek{V,U)\\T\\, sup^^siv) \\T2v\\v < \\T2\\up < ek{V,U)\\T\\. 
Therefore, UTaHLip < 3ek{V, U)\\T\\. Now we prove that there exists a Lipschitz map T4 : V ^ U, 
whose restriction to L is very close to T. We apply the following lemma to -F = T3 and obtain a 
map T4, = F -.V ^U. 

Lemma C.4 (Johnson and Lindenstrauss (1984), Lemma 5). Suppose L C V and U are Banach 
spaces with dimL = d < 00, F : V ^ U is Lipschitz with F positively homogeneous (i.e. F{\v) = 
\F{v) for A > 0, f G and T : L ^ V is linear. Then there is a positively homogeneous map 
F : V ^ U which satisfies 
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• \\F\L-T\\Lip<i8d + 2)snp^^S{L)\\nv)-nv)\\v, 

• ll-^IUip < 4||F||ijp. 

Note that for every u G S{L) there exists v & A with \\u — v\\v < £■ Therefore, 

\\T3u - Tu\\v < \\T3u - TsvWv + \\T3v - Tv\\v + \\Tv - Tu\\v 
< ||r3||Lip-£ + 0+||T||£< (3efe(F,C/) + l)||r||£. 

Hence, 

||74|l - T\\up < {8d + 2)(3efe(F, U) + l)\\T\\e < 40dek{V, U)\\T\\e, 

and ||r4||i;,jp < 12ejt(y, C/)||r||. Finally, we approximate T4 with a linear bounded map Ts : F — )• [/, 
whose restriction to L is very close to T. 

Lemma C.5 (Johnson and Lindenstrauss (1984), Proposition 1). Suppose L CV and U are Banach 

spaces, U is a reflexive space, f : V L is Lipschitz, and T : L ^ U is bounded, linear. Then 
there is a linear operator F : V ^ U that satisfies \\F\\ < \\f\\Lip and \\F\l — T\\l^u < — C^IUip- 

Since the space U is finite dimensional, it is reflexive. We apply the lemma to f = T4 and 
obtain a linear operator :V ^ U such that ||r5|| < 12ejk(F, C/)||T|| and 

WniL - T\\l^u < 40defe(F, U)\\T\\e. 

Let P : U ^ T{L) be a projection of U on T{L) with ||P|| < \fd (such projection exists by the 
Kadec-Snobar theorem). Consider a linear operator = Tf,T~^P + {lu — P) from U to U. Note 
that for every u eU, 

\\(j)u -u\\u = \\T5T-^Pu - Pu\\u = Wnr-^Pu - TT-'^Pu\\u < 40defe(F, U)\\T\\s ■ \\T-^Pu\\u 
< 4:0dek{V, U)\\T\\e ■ \/d||r-^|| < 40ac/^e||?i||t7 

(we used that ekiV,U) < Vd and ||P|| < \/d). We choose e ^ l/{alog^k) so that 4Qa(fe < 1/2. 
Then — /[/|| < 1/2. Thus (j) is invertible: 

CO 

and 

00 

U-'\\<J2\\^u-H'<2. 

i=0 

Finally, we let T = (f)~^T^. Note that for every u €z L, (pTu = T^u = (f)Tu, thus T is an extension 
of T. The norm of T is bounded by ||(^||||T5|| < 24efe(y, f/)||T||. 
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D Improved Lower Bound on ek{ii,ii) 



After a preliminary version of our paper appeared as a preprint, Johnson and Schechtman notified us 
that our lower bound of Q ( \/log k / log log k) on ek{ii,ii) can be improved to ( y/log k / log log k) . 
This result follows from the paper of Figiel, Johnson, and Schechtman (1988) that studies factoriza- 
tion of operators to Li through Li. With the permission of Johnson and Schechtman, we present 
this result below. 

Before we proceed with the proof, we state the result of Figiel, Johnson, and Schechtman (1988). 

Theorem D.l (Corollary 1.5, Figiel, Johnson, and Schechtman (1988)). Let X be a d- dimensional 
subspace of Li(R, fi) (a set of real valued functions on R with the \\ ■ ||i norm). Suppose that for 
every f ^ X and every 2<r<oo, ||/||r< C'v^ll/lli (where C is some constant not depending on 
f and r). Let w : X ^ PJ^ and u : ^ Li{R, fi) be linear operators such that uw = Ix is the 
identity operator on X. Then 

rankn > 2^'^ where A 



{i6CdBM{x,e^^)\\w\\\\u\\y 

Corollary D.2. ek{£iJi) = 1^ (^/k^/ log log fc) . 

Proof. Denote d = clog A;/ log log /c, where c is the constant from Theorem I C.l[ Consider U = 
By Kashin's theorem (Kashin 1977), there exists an "almost Euclidean" d-dimensional subspace 
X' in [/, that is, a subspace X' such that 

ci||x||i < \/(i||x||2 < C2||x||l 

for every x & X' (and some positive absolute constants c\ and C2). Let R = {±1}^'^ C C/ be a 
2d-dimensional hypercube, be the uniform probabilistic measure on R and V = Li{R,fi). We 
consider a natural embedding u' of X' into V: each vector rc E X' is mapped to a function u'{x) G V 
defined by u'{x) : y 1— >• (x,y). Recall that by the Khintchine inequality, 

ApWxh < \\u{x)\\p = {Ey^R [\{x,y)\P])^/P < Bp\\x\\2, 

where Ap and Bp are some positive constants. In particular, Haagerup (1982) proved that the 
inequality holds for p = 1, with Ai = ^/l/2 and Bi = \/2/tt, and, for p > 2, with Ap = 1 and 

(the 0(1) term tends to as p tends to infinity). Let X C L{R, fi) be the image of X' under u' . 
Observe that u' is a (2c2/ci)-isomorphism between {X' , \\ ■ ||i) and {V, \\ ■ ||i). Indeed, 

||'u'(x)||l < i3l||x||2 < V2 ■ C2\\x\\l/VTTd, 

\\u'{x)\\i > Ai||x||2 > ci\\x\\i/V2d. 

Denote w = {u')~^. Then ||n'|| < 2c2/(\/vrci) < 2c2/ci. 

By Theorem I C.H there exists a linear extension u : U ^ V oiu' toU with ||tt|| = 0(efc(£i, ^i))||m'|| 
We are going to apply Lemma fD.ll to maps u and w and get a lower bound on ||m|| and, consequently, 
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on efc(£i,^i). To do so, we verify that for every f £ X, \\f\\r = 0{y/r). Indeed, if / = u'{x), we 
have 

r < BrWxh < BrWfh/A, = ■ ■ ||/||l(l + o(l)). 



e 

Note that rankn < dimC/ = 2d and dBMiX,£i) < Bi/Ai = 2/^. By LemmaEH we have 

" (16CdBAf(X,^^)||w)||||n||)2 - d 

Therefore, 

We conclude that 



ekihJi) > (l|u||/||n'||) >nUj^\=nl^ 



log d y \ log log k ^ 

□ 
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